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A  CORRELATION  STUDY  BETWEEN  TWO  COLOR-MEASURING  SPECTROPHOTOMETERS 


INTRODUCTION 


The  US  Army  Natick  Research,  Development  and  Engineering  Center  has 
introduced  an  objective,  computerized  method  for  evaluating  shade 
acceptability  of  dyed  and  printed  textiles  for  use  in  the  Government's 
quality  assurance  program.  This  method  utilizes  commercially  available 
ccnputer-operated  spectrophotometers .  Technological  advances  in  both  the 
optics  and  computer  industries  have  produced  a  new  generation  of  color 
measurement  instrumentation  and  conputers  at  a  moderate  cost.  Because  of 
this,  the  Army  initiated  a  program  to  develop  and  validate  an  objective 
color  measurement  system  for  determining  shade  acceptability  of 
textiles^. 

The  program  was  executed  in  four  phases.  A  survey  of  the  corrmercial 
market  was  conducted  in  Phase  1.  Three  spectrophotometers  available  at 
the  time  were  purchased  and  tested.  In  Phase  2,  a  fail-safe  calibration 
procedure  and  a  color  difference  equation  based  on  acceptability  were 
developed  under  contracts  with  Clemson  and  Lehigh  universities.^'^  A  two- 
unit  prototype  system  (which  was  later  expanded  to  include  three 
additional  satellite  units),  was  purchased  from  Applied  Color  Systems, 
Inc.  (ACS)  of  Princeton,  New  Jersey,  in  Phase  3.  These  units  were 

C  £ 

installed  and  tested  for  repeatability  and  reliability3'  .  In  Phase  4, 
three  industry  sites  were  chosen  and  an  18-month  trial  study  conducted. 
Results  indicated  that,  overall,  the  instruments  performed  well 
individually  and  as  a  system. 

The  purpose  of  this  study  was  co  determine  the  comnatibi 1 i tv  of  a 
newer  model  (purchased  in  1989)  of  the  instrument  to  the  original  1981 
prototype  instrument. 


EXPERIMENTAL  PROCEDURE 

A.  INSTRUMENTATION 

The  two  instruments  used  in  this  study  were  the  ACS  Spectro-Sensor 
(1981)  and  the  ACS  Spectro-Sensor  II,  UV  Enhanced  (1989).  Both  instruments 
are  computer- operated,  high-speed,  high- resolution,  single-beam,  scanning 
spectrophotometers,  capable  of  measuring  samples  from  400  to  1100 
nanometers  for  either  spectral  reflectance  or  transmission  values.  The  two 


instrumei”-  are  identical  in  design,  but  the  newer  instrument  has  the 
added  capability  of  detecting  fluorescence  in  a  sanple  by  means  of  an 
ultraviolet-enhanced  light  source. 

B.  SAMPLES 

A  set  of  samples  was  measured  on  the  ACS  Spectro-Sensor  (1981)  and 
then  again  measured  on  the  ACS  Spectro-Sensor  II,  UV  Enhanced  (1989).  The 
sanples  were: 

1.  Four  4"  x  4"  British  Ceramic  Research  Associations  Colour 
Standard  Series  II  enamel  tiles  (Mid  Grey,  Deep  Pink,  Bright 
Yellow  and  Cyan ) ; 

2.  Eighteen  4"  X  4"  porcelain  enamel  tiles  consisting  of  six 
standards  (two  tan,  two  green  and  two  blue)  with  a  full  and  thin 
limit  sample  for  each  standard; 

3.  Twenty  4"  X  10"  Nyco  twill  fabric  swatches,  10  tan  and  10  green; 

4.  A  pair  of  tan  polyester  gelcoat  plaques 

C.  MEASUREMENT  PROCEDURES 

The  tiles  and  fabric  samples  were  measured  for  long-  and  short-term 
results.  The  short-term  test  consisted  of  measuring  both  the  tiles  and 
fabric  swatches  once  a  day  for  10  days.  The  long-term  test  measured  the 
tiles  once  a  week  for  10  weeks,  and  twice  a  week  for  5  weeks  for  the 
fabric  swatches.  The  tan  color  difference  pair  was  measured  on  10 
separate  days  over  a  three-week  period. 

The  fabric  samples  were  marked  with  four  circles  across  their  length. 
Arrows  were  drawn  to  indicate  the  fill  direction,  so  twill  lines  were 
oriented  parallel  with  the  horizontal  plane  when  presented  to  the  sample 
port  to  minimize  the  influence  of  surface  texture  on  the  data.  The 
samples  were  backed  with  two  layers  of  the  same  shade  and  fabric  during 
the  measurement,  and  the  four  readings  were  averaged.  The  tiles  were 
marked  on  the  back  with  a  circle  to  ensure  that  the  same  area  would  be 
measured  each  time.  A  total  of  three  measurements  were  taken  without 
moving  the  tile  and  the  data  averaged.  The  tan  color  difference  pair  was 
marked  on  one  side  with  a  circle,  measured  three  times  and  the  resulting 
data  averaged.  A  grey  tile  was  used  to  back  these  sanples  because  they 
were  slightly  translucent. ^ 


2 


A  simulated  daylight  (D65)  source  was  used  to  illuminate  both  the 
tiles  and  fabric  swatches  polychrcmatically,  and  measurements  were  taken 
using  the  large  area  view  (LAV)  mode.  The  10°  1964  CIE  Supplementary 
Standard  Observer  and  CIE  Standard  Illuminant  D65  were  used  for  all 
tristimulus  value  calculations.  The  CIE  1976  L*a*b*  (CIELAB)  color  space 
was  used  for  all  color  difference  calculations.  The  two-sample  Student  t 
test  was  used  to  determine  the  significance  of  the  difference  between  two 

Q 

means. 


RESULTS  AND  DISCUSSION 

A.  SHORT-TERM  COMPARISON  OF  THE  TWO  INSTRUMENTS 

Tables  la,  lb,  and  lc  contain  the  mean  and  standard  deviation  of 
tristimulus  values  (X,Y,Z),  the  mean  color  difference  from  the  mean  (MCDM) 
of  a  set  of  samples  and  the  AE  results  for  the  tiles  and  fabric  samples. 
The  tristimulus  values  on  the  ACS  I  are  slightly  higher  than  those  on  the 
ACS  II,  for  both  the  tiles  and  fabric  samples.  The  MCDMs  are  about  the 
same  between  the  two  instruments,  except  for  one  instance  on  the  SG509 
Standard  tile  where  the  MCDM  value  on  the  ACS  I  is  considerably  higher. 

The  largest  AE  (CIELAB  color  difference  between  the  two  means)  observed 
was  0.5  CIELAB  units.  The  two-sanple  t  test  showed  only  four  instances, 
indicated  by  asterisks,  when  the  tiles  did  not  obtain  a  95%  confidence 
level.  Overall,  the  two  instruments  demonstrated  a  95%  confidence  between 
each  other. 

B.  LONG-TERM  COMPARISON  OF  THE  TOO  INSTRUMENTS 

Tables  2a,  2b,  and  2c  contain  the  long-term  results  for  the  two 
instruments.  The  tristimulus  values  were  slightly  higher  for  the  majority 
of  both  the  tiles  and  fabric  samples  on  ACS  I.  Overall  the  MCDM  and  A  E 
values  were  slightly  smaller  than  those  reported  in  the  short-term  study. 
The  MCDM  values  between  the  two  instruments  are  very  close  to  one  another. 
The  majority  of  color  differences  between  the  two  sets  range  from  0.03  to 
0.27  CIELAB  units,  with  the  exception  of  one  tile  exhibiting  a  A E  of  0.45 
CIELAB  unit  between  instruments.  The  two-sample  Student  t  test  results 
shewed  only  two  instances  where  a  confidence  of  95%  was  not  met  and  this 
is  shown  on  the  BCRA  tile  (Deep  Pink),  and  the  AG44  thin  tile.  Both  the 
Green  and  Tan  fabrics  demonstrated  no  statistically  significant 
differences  between  their  means. 
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C.  SHORT-TERM  VS.  LONG-TERM  MEASUREMENTS  ON  EACH  INSTRUMENT 

Tables  3a  -  4c  shew  that  the  two  instruments  are  in  agreement  with  one 
another  during  both  short-  and  long-term  studies.  The  tristimulus  values 
for  the  short-  and  long-term  studies  on  each  instrument  exhibited  almost 
identical  values.  The  color  differences  between  the  sets  range  between 
0.01  and  0.14  CIELAB  units.  The  A E  values  were  slightly  higher  on  the  ACS 
I.  The  two-sanple  Student  t  test  showed  no  significant  differences 
between  the  two  instruments. 

D.  COLOR-DIFFERENCE  PAIR  MEASUREMENTS  ON  EACH  INSTRUMENT 

Table  5  shows  the  results  for  each  instrument  on  a  pair  of  tan 
polyester  gelcoat  plaques.  The  tan  pair  data  illustrate  the  precision  of 
the  instruments  in  measuring  color  differences.  Both  instruments  exhibit 
excellent  correlation  measurements  and  repeatability. 

E.  MEASUREMENTS  IN  THE  NEAR- INFRARED  REGION 

Tables  6a  -  9b  contain  data  for  the  near-infrared  wavelength  region. 
Since  the  Army  has  near-infrared  reflectance  requirements  for  some 
fabrics,  this  wavelength  region  was  examined.  Integrated  values  in  the 
infrared  region  on  the  green  and  tan  fabric  samples  were  obtained.  This 
integration,  which  is  similar  to  the  calculations  for  Y  and  L*  in  the 
visible  region,  is  based  on  the  sensitivity  of  the  starlight  scope,  a 
nighttime  surveillance  device.^  The  values  Ns  and  Ls,  which  are  the 
nighttime  equivalents  to  Y  and  L*,  respectively,  are  calculated  for  two 
different  illuminants:  illumination  representing  a  moonlit  and  a  moonless 
sky.  When  determining  Ns,  the  spectral  response  of  the  night  vision  device 
replaces  the  observer,  and  the  spectral  power  distribution  of  a  moonlit  or 
moonless  sky  replaces  the  standard  illuminant  in  the  Y  calculation.  Values 
of  Ns  are  converted  to  the  lightness  analog,  Ls,  to  more  closely  relate 
these  values  to  the  lightness  level  seen  through  an  image  intensifier,  in 
the  same  manner  that  Y  is  converted  to  L*. 

Tables  6a  -  7b  contain  the  long-  and  short-term  data  between  the 
two  instruments.  The  long-  and  short-term  two-sanple  Student  t  test 
results  on  the  green  fabric  were  excellent.  There  were  only  two  instances 
where  the  measurements  from  the  two  instruments  did  not  meet  a  95% 
confidence  limit. 
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However,  the  tan  fabric  samples  for  both  the  long-  and  short-term  studies 
exhibited  14  instances  where  a  confidence  limit  of  95%  was  not 
obtained. 

Tables  8a-9b  contain  the  intrainstrument  repeatability  data  for  the 
long-  and  short-term  studies.  The  two-sample  Student  t  test  results  on 
both  the  green  and  tan  fabrics  were  excellent.  There  were  no  instances 
where  a  95%  confidence  level  was  not  reached. 

CONCLUSIONS 

A  summary  of  the  color  differences  and  MCDM  averages  for  all  sanple 
sets  appear  in  Tables  10a  -  lOd.  The  two  instruments  show  excellent 
repeatability  agreements  for  the  color  differences  and  MCDM  averages,  both 
interinstrumentally  and  as  separate  units.  Overall,  there  were  no 
significant  differences  between  the  two  instruments.  This  resulted  in  a 
95%  confidence  between  the  two.  Thus,  the  two  instruments  and  their 
interchangeable  use  prove  to  be  more  than  suitable  for  the  Army's 
needs. 


TABLES 

The  following  pages  contain  Tables  1  through  10. 
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Table  la.  Comparison  of  Short-Term  Repeatability  for  the  Tile  Samples  between  ACS  I  and  ACS  II: 
Mean  and  Standard  Deviation  (+/-)  of  Tristimuius  Values  (X,Y,Z) 
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Table  la.  Comparison  of  Short-Term  Repeatability  for  the  Tile  Samples  Between  ACS  I  and  ACS  II: 
Mean  and  Standard  Deviation  (+/-)  of  Tristimulus  Values  (X.Y.Z)  (cont.) 
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Table  lc.  Comparison  of  Short-Term  Repeatability  for  the  Green  Fabric  Samples  between  ACS  I  and  AC 
Mean  and  Standard  Deviation  (+/-)  of  Tristimulus  Values  (X,Y,Z) 
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Table  2a.  Comparison  of  Long-Term  Repeatability  for  the  Tile  Samples  between  ACS  I  and  ACS  II 
Mean  and  Standard  Deviation  (  +  /-)  of  Tristimulus  Values  (X,Y,Z) 
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Table  2a.  Comparison  of  Long-Term  Repeatability  for  the  Tile  Samples  between  ACS  I  and  ACS  II: 
Mean  and  Standard  Deviation  (+/-)  of  Tristimulus  Values  (X,Y,Z)  (cont.) 
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Table  2b.  Comparison  of  Long-Term  Repeatability  for  the  Tan  Fabric  Samples  between  ACS  1  and  ACS  II: 
Mean  and  Standard  Deviation  (+/-)  of  Tristimulus  Values  (X,Y,Z) 
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Table  3a.  Comparison  of  Short-  and  Long-Term  Repeatability  for  the  Tile  Samples  on  the  ACS 
Mean  and  Standard  Deviation  (+/-)  of  Tris t imulus  Values  (X,Y,Z) 
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Table  3a.  Comparison  of  Short-  and  Long-Term  Repeatability  for  the  Tile  Samples  on  the  ACS 
Mean  and  Standard  Deviation  (+/-)  of  Tristimulus  Values  (X,Y,Z)  (cont.) 
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Table  3b.  Comparison  of  Short-  and  Long-Term  Repeatability  for  the  Tan  Fabric  Samples  on  the  ACS  1 
Mean  and  Standard  Deviation  (+/-)  of  Tristimulus  Values  (X,Y,Z) 
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Table  3c.  Comparison  of  Short-  and  Long-Term  Repeatability  for  the  Green  Fabric  Samples  on  the  ACS 
Mean  and  Standard  Deviation  (+/-)  of  Tristimulus  Values  (X,Y,Z) 
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Table  4a.  Comparison  of  Short-  and  Long-Term  Repeatability  for  the  Tile  Samples  on  the  ACS  II: 
Mean  and  Standard  Deviation  (+/-)  of  Tristimulus  Values  (X,Y,Z) 
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Table  4a.  Comparison  of  Short-  and  Long-Term  Repeatability  for  the  Tile  Samples  on  the  ACS  II: 
Mean  and  Standard  Deviation  (+/-)  of  Tristimulus  Values  (X,Y,Z)  (cont.) 
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Table  4a.  Comparison  of  Short-  and  Long-Term  Repeatability  for  the  Tile  Samples  on  the  ACS  II: 
Mean  and  Standard  Deviation  (+/-)  of  Tristimulus  Values  (X,Y,Z)  (cont.) 
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Table  4b.  Comparison  of  Short-  and  Long-Term  Repeatability  for  the  Tan  Fabric  Samples  on  the  ACS  II: 
Mean  and  Standard  Deviation  (+/-)  of  Tristimulus  Values  (X,Y,Z) 
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Table  4c.  Comp  rrison  of  Short-  and  Long-Term  Repeatability  for  the  Green  Fabric  Samples  on  the  MS  II 
Mean  and  Standard  Deviation  (+/-)  o£  Tristimulus  Values  (X,Y,Z) 
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Table  5.  C1ELAB  Color  Differences  for  Tan  Color 
Difference  Pair 


Observation  _ &CS  i 

1  1.91 

2  1.89 

3  1.90 

4  1.90 

5  1.91 

6  1.91 

7  1.90 

8  1.91 

9  1.92 

1°  1.94 


ACS  II 

1.91 

1.91 

1.91 

1.92 

1.92 

1.92 

1.91 

1.90 

1.90 

1.94 


Average 


1.91 


1.91 


Table  6a.  Comparison  of  Short-Term  Infrared  Repeatability  for  the  Green  Fabric  Samples  Between  ACS  I  and  ACS  II: 
Mean  and  Standard  Deviation  (+/-)  of  Starlight  Scope  Values  (Ns.Ls) 
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Table  6b.  Comparison  of  Short-Term  Infrared  Repeatability  for  the  Tan  Fabric  Samples  between  ACS  1  and  ACS  II: 
Mean  and  Standard  Deviation  (+/-)  of  Starlight  Scope  Values  (Ns,Ls) 
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Table  7b.  Comparison  of  Long-Term  Infrared  Repeatability  for  the  Tan  Fabric  Samples  between  ACS  I  and  ACS  II 
Mean  and  Standard  Deviation  (+/-)  of  Starlight  Scope  Values  (Ns.Ls) 
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Table  8a.  Comparison  of  the  Short-  and  Long-Term  Infrared  Repeatability  for  the  Tan  Fabric  Samples  on  the  AC 
Mean  and  Standard  Deviation  (+/-)  of  Starlight  Scope  Values  (Ns,Ls) 
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Table  8b.  Comparison  of  the  Short-  and  Long-Term  Infrared  Repeatability  for  the  Green  Fabric  Samples  on  the 
Mean  and  Standard  Deviation  (+/-)  of  Starlight  Scope  Values  (Ns,Ls) 
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Table  9a.  Comparison  of  the  Short-  and  Long-Term  Infrared  Repeatability  for  the  Tan  Fabric  Samples  on  the  AC 
Mean  and  Standard  Deviation  (+/->  of  Starlight  Scope  Values  (Ns,Ls) 
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Table  10a.  Comparison  of  Average  Short-Term  Values* 
for  the  Two  Instruments 


Average  MCEM  Average  &E 


Sample 

ACS  I 

ACS  II 

Tiles 

0.04 

0.04 

0.14 

±  0.02 

±  0.02 

0.10 

Greens 

0.06 

0.06 

0.16 

±  0.02 

±  0.01 

0.02 

Tans 

0.05 

0.04 

0.09 

+  0.01 

±  0.01 

0.02 

Table  10b.  Comparison  of  Average  Long-Term  Values 
for  the  Two  Instruments 

Average  MCEM  Average 

Sample _ ACS  I _ ACS  II _ 


Tiles 

0.04 

0.04 

0.14 

+  0.02 

+  0.02 

0.10 

Greens 

0.08 

0.08 

0.18 

+  0.02 

+  0.01 

0.03 

Tans 

0.05 

0.05 

0.10 

±0.01 

±0.01 

0.02 

*MCEM  =  Mean  Color  Difference  from  the  Mean 

*Ae  =  CIELAB  Color  Difference  between  the  Two  Means 
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Table  10c.  Comparison  of  Average  Long-  and  Short-Term 
Values  for  the  ACS  I  Instrument 


Average  MCEM  Average 


short 

iong 

Tiles 

0.04 

0.04 

0.05 

±  0.02 

±  0.02 

0.04 

Greens 

0.07 

0.08 

0.05 

±  0.01 

±  0.02 

0.04 

Tans 

0.05 

0.05 

0.03 

+  0.01 

±0.01 

0.01 

Table  lOd.  Comparison  of  Average  long-  and  Short-Term 

Values 

for  the  ACS  II  Instrument 

Average  MCEM 

Average  £>E 

RglraSi 

SHORT 

LONG 

Tiles 

0.04 

0.04 

0.02 

±0.01 

±0.02 

0.02 

Greens 

0.06 

0.08 

0.05 

±o.oi 

±  0.01 

0.03 

Tans 

0.04 

0.05 

0.03 

±0.01 

±0.01 

0.01 
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